DFR2000.004A PATENT 
IMPROVED OPTICAL DESIGN FOR FILM CONVERSION DEVICE 

This application claims the benefit of U.S. Provisional Application No. 
60/172111, filed December 23, 1999 and U.S. Provisional Application No. 60/180318 
5 filed February 4, 2000. 

Field of the Invention 
This invention relates to film conversion devices which transfer information on 
film to other media. 

Background of the Invention 

10 The term "telecine'' refers to the process of generating a television signal or at 

least a video signal from cinematographic film, i.e., generally speaking film to video 
conversion. A telecine machine converts images, and possibly sound and/or other 
cinemetographic information, that are recorded on film into a video format. This video 
signal may be subsequently recorded on another medium such as on videotape by using 

15 for example a video tape recorder film. The resultant video signal, however, may 

contain ancillary information not recorded on film. For example, in the case where 
audio is not recorded on the film, an audio signal may be received into an auxiliary 
input on the telecine machine and incorporated into the video signal produced by the 
telecine machine. The images are converted into video and supplemented with audio to 

20 produce a video signal that includes both images and the sounds. Other information not 

recorded on film but possibly incorporated into the resultant video signal include e.g., 
close captioning. 

When television first became popular, the state of technology was such that a 
device to convert images recorded on film into video was quite large and heavy. Since 

25 the video tape recorder for storing video electronically was not available until after a 

number of years of commercial TV broadcasting, the telecine device was designed to be 
used in a broadcast studio connected to the TV broadcast transmission system. 
Subsequent designs of fiiU-featured telecine devices have followed the original concept 
of a large system that is permanently installed. 

30 To transfer film onto video, the telecine device is typically loaded with a spool 

of film which uses its transport mechanism to move the film across a beam of light. 
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Light that passes through the film is directed through lenses, filters and other optical 
elements towards a series of sensors that convert optical images of consecutive portions 
of the film into video signals. Outputs from the sensors are processed in a number of 
ways to improve or modify the video image, such processors being used, for example, 

5 to enhance, color correct, filter, anti-alias, pan and scan, crop and compress the new 
version of the image. The telecine device provides its data in a particular analog or 
digital format suitable for storage or further processing or display or conversion into a 
video signal on an output port and continues to do so until the entire spool of fihn has 
been processed or until the telecine operator terminates the process. Some telecine 

10 devices are equipped with local memory storage that can hold data corresponding to 

scanned fihn frames for reference or for additional processing. 

Telecine devices typically operate at a real-time (e.g., 24 frames-per-second) or 
slower rate. It is common to use 24 frames of film to record one second of motion. The 
operating rate of the telecine device is typically at or less than the real-time rate, even 

15 for films that are recorded at a faster rate than the real-time rate. Devices (i.e., video 

recorders) coupled to the output of the telecine device expect the telecine device to 
provide video signals conforming to a particular video standard. 

Popular video standards include the National Television System Committee 
(NTSC) standard in America and Asia, the Phase Altemating Line (PAL) standard in 

20 most European countries, and the Sequential Couleur Avec Memoire (SECAM) 
standard in France. Each video standard defines a particular resolution (i.e., number of 
lines per frame) and a particular number of frames per second. Each video standard is 
incompatible with the other. For example, a European video conforming to the PAL 
standard cannot be played on an American videocassette player or shown on American 

25 television that expects the video to conform to the NTSC standard. The timing 

specifications are different for different video standards. To maintain the proper timing 
for a desired video standard, the telecine device typically operates at the real-time or 
slower rate. When the telecine device is operating at the slower than real-time rate, the 
outputs can be buffered until there is a reasonable collection of video information to 

30 start or resume a video recording conforming to the desired video standard. In order to 
match 24 frames-per-second to NTSC, extra frames are added. 
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Ancillary information, such as audio and metadata information, is synchronized 
with the video images. Ancillary information can be provided by the film, a digital file 
or a peripheral device connected to the telecine device. Pitch converters can adjust the 
audio speed to match the conversion rate of the telecine device. Film rates and video 
5 rates differ. Pitch converters resynchronize the audio with the video so that sound 

appears to coincide with motion. For example, when 24 frames-per-second film is 
converted to 29.97 NTSC video, the audio speed must be changed to match the motion 
in the eventual playback of the resulting video. Some pitch converters can adjust the 
audio speed in the -25% to +33% range. 

10 Summarv of the Invention 

The preferred embodiment of the present invention is a high performance film 
conversion device having a plurality of advantages over conventional telecine devices. 
The film conversion device has an optical system which is smaller, lighter and also 
lower in cost to manufacture than prior art telecine devices. A particular feature of the 

15 preferred embodiment of this invention is that a subsystem of the film conversion 

device, namely the optics and film-to-video sensors, is enclosed in a separate module. 
This feature has a number of significant advantages. The smaller size of the optical 
system makes it easier than with systems presently available to enclose the main 
components of the optical system in a dust-fi:ee enclosure that also protects the 

20 components fi*om extemal illumination. The small size additionally makes it easier to 
enclose these components in an electrically isolated environment. The compact size of 
the scanning subassembly of the preferred embodiment also makes it easier than in the 
prior art telecine devices to maintain a stable thermal environment for the optical 
system. One advantage stemming from the removability of the optic/sensor module is 

25 improved serviceabihty of the components of the optical system. The preferred 

embodiment of the present invention also reduces the interference of the components of 
the optical system with the path of the film transport. 

In the preferred embodiment of the present invention, the optical path of the 
main subsystems of the optical system is folded substantially into the shape of a "U", 

30 This folded arrangement is achieved by placing optical beam bending elements in the 

optical path of the film conversion device between the illumination subsystem and the 
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film guide subsystem, and between the film guide subsystem and the imaging 
subsystem. This folded arrangement of the components of the optical system permits 
the components of the illumination subsystem and the imaging subsystem to be 
mounted back-to-back on the same support structure within the film-to-video module. 
5 Consequently, the optical system requires less space than is required without the folding 

of the optical path. The reduced size of the optical system and its support structure 
allows construction of the optical system of a film conversion device that is smaller, 
lighter, lower in cost, easier to enclose in a contamination-free environment, easier to 
enclose in an electrically shielded environment, and easier to make thermally stable than 

10 the conventional arrangement. An additional advantage of the present invention is that 
by having the illumination subsystem, the imaging subsystem, and the fihn guide 
subsystem arranged on separate segments of the "U" shape described above, 
interference between the optical system and the film handling path of the film 
conversion device is minimized. The preferred embodiment of the present invention 

15 also provides improved serviceability of the optical system by using replaceable 

windows between the accessible area of the film path and the protected areas of the 
remainder of the optical components. 

Another feature of the present invention is to provide a stand-by mode of 
operation for a film conversion device in which the lifetime of the illuminating lamp 

20 may be extended by turning it off when not scanning film, but that does not require a 
long delay after powering the lamp for the optical system to stabilize. An additional 
advantage of the invention permits a film conversion device with an optical system 
which has improved thermal stabihty. In the preferred embodiment, this is achieved by 
placing a heating element near to the illuminating lamp of a film conversion device but 

25 not in its optical path. The power dissipated in the heating element is reduced when the 

lamp is turned on and is increased when the lamp is turned off so as to maintain 
substantially constant total power dissipation in both situations. 

This invention includes a digital parallel-processing core to reduce the time and 
the cost of a film conversion session. In recent years, digital technology has extended 

30 the choices for processing, storing and retrieving information. Video and audio 

information is stored digitally in computer files. Digital Versatile Discs (DVDs) or Non- 
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Linear Editor (NLE) files. NLE files are manipulated by television and motion picture 
personnel on computer-based editing workstations in preparation for a distribution or 
release of a show or motion picture. Digital files reliably maintain their quality and 
fidelity after many uses. The digital storage methods provide viable commercial 
5 alternatives to real-time video processing for the storage, retrieval and transmission of 

video information. 

The film conversion device can operate faster than the real-time rate by 
processing and assembhng an output in a digital format. In the simplest form, a digital 
file is a sequence of binary data (i.e., ones and zeros). The speed at which the binary 

10 data is created does not affect the playback speed. If the binary data is in the proper 
digital format upon completion of the film conversion session, the information 
represented by the binary data plays properly on the intended equipment. Therefore, the 
film conversion device with a digital output can operate at increased rates. By running 
the film conversion session at faster than real-time, less time is taken to process a spool 

15 of film. The total time to convert an entire motion picture is significantly reduced, 

resulting in cost savings. Furthermore, the output in the digital format can be converter 
to an analog format by a digital-to-analog converter. 

Because of the parallel processing architecture, the film conversion device can 
simultaneously provide outputs in a variety of analog and digital formats. More time 

20 and cost savings are realized as separate film conversion sessions or further processing 

of outputs are unnecessary to convert film into two or more formats. 

In the preferred embodiment, configurable electronics in the digital parallel- 
processing core provide efficiency and flexibility. Field Programmable Gate Array 
(FPGA) elements can handle specific repeating operations efficiently while general 

25 purpose Digital Signal Processor (DSP) elements provide flexibility. The electronics of 
the processing core can be chosen to match a particular application, budget or 
performance. For example, amateurs, students or low budget filmmakers can choose a 
downscaled version of the film conversion device that provides minimum processing. 
An upscaled version of the film conversion device can provide increased processing 

30 power and throughput suitable for delivering high definition video or transferring at 
rates faster than real-time. The difference between the upscaled version and the 
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downscaled version lies in the number of FPGA or DSP elements and the functions they 
are designed to perform. In one embodiment, different versions of film conversion 
devices are produced in a factory to meet the needs of different operators. In an 
alternate embodiment, the operator can add, replace or remove components on the 
5 digital parallel-processing core to achieve the desired level of performance. 

Digital components generally consume less power and occupy less space than 
their analog counterparts. FPGA and DSP elements are high-speed devices that can 
readily adapt to evolving file standards. 

As apparent from the foregoing, the present invention includes many and varied 

10 aspects. One specific aspect of the invention disclosed comprises an optical system 

having a folded light path for generating electrical signals representing images 
contained on motion picture film. The folded light path comprises three segments. The 
first segment and the third segment are substantially parallel and the second segment is 
approximately orthogonal to the first and third segments. A lamp is included in the first 

15 segment. An aperture proximate the film is located in the second segment, and a 
photosensitive detector is located in the third segment. Beam bending optics are 
inserted between the first and second segment and between the second and third 
segments. 

Another aspect of the invention includes a device having a scanning module in 
20 which light producing components and a detector for converting an image recorded on a 

film into electronic data are substantially sealed in a region remote from the film. The 
device comprises a modular enclosure resealable against dust and against particulate 
matter from the film. The device further comprises a first and second glass window in 
the enclosure resealable against dust and against particulate matter from the fihn. A 
25 lamp is housed within the modular enclosure, and a film guide is mounted to an outside 

surface of the enclosure between the first and second windows. The film guide has an 
aperture therein. Mounted within the enclosure, at a location where light from the lamp 
passes through the aperture in the film guide and to the photosensitive detector, is a 
photosensitive detector. 

30 
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Brief Description of the Drawings 
Figure 1 is a general view of a preferred embodiment of a film conversion 
device constructed in accordance with this invention including a scanning subassembly 
constructed in accordance with the present invention; 
5 Figure 2 is a drawing of the components of a folded scanning subassembly of the 

preferred embodiment; 

Figure 3 is a perspective view of the preferred embodiment of the scanning 
subassembly of this invention shown in a cut-away view; and 

Figure 4 is a block diagram of the electrical and electronic components located 
10 within the scanning subassembly of the preferred embodiment of this invention. 

Figure 5 is a functional block diagram for processing of images in one 
embodiment of a film conversion device. 

Figure 6 is a block diagram of electronics in a parallel-processing core of a film 
conversion device. 

15 Figure 7 is a functional block diagram for processing of ancillary information in 

a film conversion device. 

Figures 8A and 8B hst throughput rates for various video formats using one 
embodiment of a film conversion device. 

Overall Description of the Film Transfer Device and System 

20 Figure 1 shows a general view of a film conversion device constructed in 

accordance with the preferred embodiment of this invention. As used herein, the term 
"film conversion" refers to the process of generating of a television or video signal or a 
digital signal from cinematographic film. A film conversion device, as used herein, 
converts images, audio, metadata, and/or other ancillary information recorded on film 

25 into video or digital data formats, recorded in any number of ways including but not 

hmited to, electronically, magnetically and/or optically. The resultant video or digital 
data signal also may contain ancillary information not recorded on film. For example, 
in the case where audio is not recorded on the film, an audio signal may be received into 
an auxiliary input on the film conversion device and incorporated into the video or 

30 digital data signal produced by the film conversion device. The images are converted 
into video or digital data and supplemented with audio to produce a video or digital data 
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signal that includes both images and the sounds. Other information not recorded on 
film but possibly incorporated into the resultant video or digital data signal include e.g., 
metadata information directed to close captioning features. The term "film conversion" 
therefore includes telecine, which comprises the conversion of images, audio, metadata 
5 and/or other ancillary information recorded on film into video as well as the conversion 
of images, audio, metadata and/or other ancillary information recorded on film into 
digital data. Any device that converts information such as, but not limited to, picture, 
sound, metadata, and other ancillary information, into electronic analog or digital 
signals, is defined herein as a film conversion device. The video or digital data signals 

10 produced by the film conversion device may further be converted into optical or 

magnetic signals and be transmitted optically such as, for example, down an optical 
fiber line or may be recorded optically on an optical disc such as a CD or DVD, or may 
be recorded magnetically using magnetic storage media. 

As shown in Figure 1, to accomplish film conversion, motion picture film 4 is 

15 placed on the supply spool 3 of a film conversion device 1 housed in a housing 100 such 
that the film 4 travels through a scanning subsystem 6 and onto take-up spool 9. As 
described more fully below, scanning subsystem 6 is advantageously contained in a 
separate module including film guide plate 8. Idler rollers 5 and tensioning rollers 7 
mounted on film transport plate 2 control the path of film 4 past scanning subsystem 6. 

20 Motors (not shown) are located within the interior of the film conversion device 1 and 

drive the film spools 3, 9 to propel the film 4 through the scanning subsystem 6. As 
described below, a portion of film 4 is illuminated as it passes through the scanning 
subsystem 6, and an image of that portion of film 4 is formed on photosensing elements 
which provide electrical signals corresponding to the film image. These signals are 

25 processed by electronic circuitry 10, and the resulting data is provided as output on data 
ports 13 or on removable media 14. The cover 19 serves to protect film 4 and other 
components on film transport plate 2 from accidental damage or contamination, and 
removable panel 11 similarly protects electronic circuitry 10. Cover 19 is 
advantageously formed of a translucent plastic to allow the operator to watch the 

30 movement of film 4. The interior of the film conversion device 1 contains other 
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components which are not shown, but are well known to those skilled in the art such as, 
for example, a power supply and fan. 

Appropriate devices enable the operator to observe and control the operation of 
the film conversion device 1. These devices may include, among others, a control 
5 computer monitor 17, control device or mouse 15 and keyboard 16 connected to the 
film device 1 through control ports 12. Other specific controls include a jog-shuttle and 
split screen levers (both not shown). A display device such as a monitor 18 allows the 
operator to monitor the images being produced by the film conversion process. 
Scanning Subsystem 6 

10 A significant feature of the preferred embodiment of this invention is its modular 

construction wherein the optical to video elements are housed in their own casing 97 
(shown in Figure 3) of which only the film guide plate 8 is shown in Figure 1. 
Casing 97 is thus contained within the film conversion device housing 100. 

As described below, this modular construction enables the optical and electronic 

15 imaging components to be advantageously contained within a separate enclosure within 

the film conversion device. In one embodiment, this enclosure is sealed to provide a 
dust-fi'ee environment for the precision optical and electronic elements. Preferably this 
enclosure is resealable. 

The overall design of this preferred embodiment of the scaiming subassembly 6 

20 utiUzes a folded optics assembly to achieve the compact modular scanning subsystem 
within its own separate housing. The primary components of this folded optics 
assembly are separately illustrated in Figure 2 for ease of understanding. 

With reference to Figure 2, an illumination subassembly 8 1 is located within a 
compartment of subsystem 6 and includes spherical mirror 20, lamp 22, first condenser 

25 lens 24 and second condenser lens 27. The light from lamp 22 is concentrated by the 
pair of condenser lenses 24 and 27 onto the film 4 as it passes across a film aperture 33 
in the film guide 34. Optical filter 26 is advantageously included to reduce the energy 
of illumination emitted by lamp 22 which are not useful to the imaging process, i.e., 
rays of light which are not of the desired orientation or wavelength. Filter 26 thus 

30 serves to protect the film 4 from unwanted exposure to radiation such as infrared 
radiation. Shield 28 also limits the illumination falling on film 4 to exclude incident 
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rays of light which are not useful to the imaging process. Likewise, shutter 29 is useful 
for blocking light radiating from lamp 22 when such illumination is not necessary to the 
film conversion process, for example when the movement of film 4 is stopped. 
Additionally, baffles (not shown) may be included as is well known in the art to reduce 
5 stray light. 

An alternative illumination subassembly (not shown), can include a light- 
integrating chamber having a hollow container whose interior surface is diffusely 
reflecting. A source of illumination such as a lamp is placed inside the chamber, and 
Ught is emitted through an aperture in the chamber which does not give a direct view of 

10 the source of illumination. When the lamp and the aperture are small with respect to the 
reflecting surface, and the reflectivity is high, Ught emitted from the aperture will be 
substantially uniformly distributed across the aperture. 

In the embodiment shown, a vertical illumination optical path 21 is bent through 
an angle of approximately ninety degrees by mirror 30 to become a substantially 

15 horizontal optical path 31 passing through glass window 32, and then through aperture 

33 in film guide 34 where it illuminates film 4. The optical path 37 of light which has 
passed through film 4 passes through glass window 36 and then is bent through an angle 
of approximately ninety degrees by mirror 38 into vertical optical path 39 parallel to 
path 21. Front-silvered mirrors are advantageously used as 45° reflection mirrors 30 

20 and 38 that are oriented 45° with respect to the vertical and horizontal optical paths 21, 
37, 39. These mirrors 30, 38 eliminate the light dispersion otherwise caused if the Ught 
rays pass through an extra thickness of glass as in, for example, a right angle mirrored 
prism. 

The light traveUng along path 39 results from the light passing through the 
25 narrow film aperture 33 in film guide 34. Light in light path 39 is directed through a 

prism 42 for splitting the image into different wavelength components for recreating 
electronically the color of the film image. This light in path 39 is focused by imaging 
lens 40 to form a precise projected image of the film 4 on optical sensors 54, 64, 74, 

The visible Ught in optical path 41 is separated into primarily long wavelength 
30 (e.g. Red) optical path 50, mid-range visible wavelength (e.g., Green) optical path 60, 
and primarily short wavelength (e.g. Blue) optical path 70. Imaging lens 40 forms a real 
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image of a portion of film 4 on linear photosensor arrays 54, 64, 74. The Red image is 
focused on linear photosensor array 54, the Green image is focused on linear 
photosensor array 64, and the Blue image is focused on hnear photosensor array 74. As 
shown, optical paths 50, 60 and 70 pass through one or more optional optical fiUers 51, 
5 52, 53, 61, 62, 63, and 71, 72, 73. Such optical filters, for example, may be selected to 
provide a spectral response in each optical path 50, 60, and 70, respectively, to match 
the spectral characteristics of the particular type of film 4 being scanned through the 
film conversion device 1. In another embodiment, birefiingent crystal fihers provide a 
controlled amount of spreading of the image spatially across the Hnear arrays 54, 64, 74 

10 in order to reduce aliasing in the corresponding sampled image. 

The preferred embodiment of the invention utilizes for prism 42 the Optec 
Three-Channel Prism (part number 2696102) sold by Richter Enterprises, 20 Lake 
Shore Drive, Wayland, MA 01778, and for each of the linear photosensor arrays 54, 64, 
74, the Line Scan Camera RS 644 (part number TH78CD 14) sold by Thomson 

15 Components and Tubes Corporation, TCS Division, 40 G Commerce Way, Tohoma, 

New Jersey 07511-1154. 

An alternative arrangement for obtaining electronically information 
corresponding to the red, green, and blue spectral region eliminates the prism 42 and 
substitutes a different sensor (not shown) for the three linear sensor array 54, 64, 74 

20 shown in Figure 2. This different sensor has three separate lines of sensing elements 
close together on the same semiconducting substrate. Separate color filters are located 
over each line of sensing elements to give separate electronic signals corresponding to 
the red, green and blue spectral regions of the image projected onto them. By way of 
specific example, this type of sensor is available as part number ILX528K fi*om Sony 

25 Electronics, Inc., Semiconductor Business Device, 3300 Zanker Road, San Jose, 

Cahfomia 95134. 

The optical system has specific performance requirements which influence the 
dimensions of the system. In the present preferred version of a film transfer device, 
imaging lens 40 forms an image of a strip of 35-mm film on the three linear photosensor 
30 arrays 54, 64, 74. Both the film width and the preferred linear photosensor arrays 54, 

64, 74 are approximately 20 mm long. In the design of lenses, it is progressively harder 
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to maintain good image quality as the angle of view of object or image becomes greater 
than a few degrees. To have a high quality image over the whole length of the linear 
photosensor array and at a reasonable cost, the lens should have a focal length 
significantly longer than the dimensions of object or image, so that the angle of view is 
5 minimized. However, the diameter or aperture of the lens relative to its focal length is 

also an important design characteristic. This ratio of diameter or aperture to focal length 
must be made large enough to be able to have adequate light-gathering abiUty, and also 
to minimize necessary diffraction effects. In particular, for a given application, a 
minimum ratio of diameter to focal length will be required based on the specific image 

10 resolution desired. However, if the focal length is made too long, then to maintain this 

ratio the lens must be large and, therefore, expensive. Based on these and other 
considerations, the optical system of the preferred embodiment uses a lens 40 of focal 
length approximately 80 mm and diameter or aperture of approximately 20 millimeters 
but the focal length may otherwise range from about 25 to 200 millimeters and have a f- 

15 number ranging from about 2 to 8, respectively. Note that a large aperture lens also 
reduces the effect of blemishes on the film surface. 

The lens design is optimized for approximately unity magnification given that 
the film width and linear photosensor array length are similar in size. To provide unity 
magnification, the object and image are located at the conjugate points, in this case, 

20 each approximately 160 mm from the lens. This then determines that the minimum 
distance from film 4 to Unear photosensor arrays 54, 64, 74 will be about 320 nrni. The 
conjugate points and the minimum optical path distance from the film 4 to the linear 
photosensor arrays 54, 64, 74, may otherwise range from between about 50 to 400 
millimeters and from about 100 to 800 millimeters, respectively. 

25 Certain components are also shown in Figure 2, which while not essential to the 

illumination and imaging described above, are advantageous for improving the 
performance of the system. Photosensor 47 is located in the path of light from lamp 22 
in such a location that it does not obstruct the light passing through shield 28 for 
illuminating film 4, but still samples the characteristic illumination provided by the 

30 lamp 22 through the first and second condenser lenses 24 and 27 and optical filter 26. 

Measurements of the intensity of illumination falling on photosensor 47 over the first 
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few minutes or hours after turning on the lamp 22 provides information to the operator 
(or controls an automatic process based on the measured intensity) as to when the 
illumination has stabilized sufficiently for optimum system performance. Other 
examples of use for sensor 47 are (i) monitoring changes over a much longer time to 
5 determine the useful hfetime of the lamp 22, and (ii) directing feedback from this 

measurement of the illumination to the power supply driving the lamp 22, so that the 
illumination of the lamp 22 is stabilized. 

Although the photosensor 47 is shown in Figures 2 and 3 as being situated 
between the lamp 22 and the aperture 33 in the film guide 34, the location of the 

10 photosensor is not so limited. This photosensor 47 may be on either side of the aperture 
33 and the film 4, and may be located on the film guide itself, however, preferably the 
photosensor is positioned so as to receive hght that does not pass through the aperture 
and/or the film. Altematively, one or more of the photosensors 54, 64, 74, may be 
employed to determine the output intensity of the lamp 22 without the aid of 

1 5 photosensor 47. 

Preferably, however, photosensor 47 has an electrical output that is electrically 
connected to circuitry in the film conversion device 1 suitable for processing the signal 
generated by the photosensor 47. The circuitry, for example, may monitor the electric 
signal output from the photosensor 47 to determine when the lamp 22 output has 

20 stabilized and may be directed to a user interface in the form of an indicator lamp or 

hght emitting diode (LED) on the console of the device 1 or to a computer interface and 
a monitor like monitor 17. Altematively, the circuitry may control the flow of electrical 
power to the lamp 22. This circuitry may be incorporated in a power supply the powers 
the lamp 22 or may comprise other control electronics, herein designated as a power 

25 regulator, that acts as a valve that controls the amount of electrical power dehvered to 

the lamp. An example of a power regulator would be a variable gain ampUfier 
comprising high power op-amps. 

Having a photosensor 47 that monitors the output of the lamp 22 is especially 
useful for applications that exploit the portable nature of preferred embodiments of the 

30 film conversion device 1. As this portable device 1 is moved about, it will be exposed 
to different environments with differing environmental conditions such as, for example, 
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temperature. Having a sensor 47 that monitors the lamps 22 Hght output, which may 
vary with ambient temperature, is useful as the environmental conditions such as 
temperature change. This photosensor 47 will be especially advantageous when the 
film conversion device 1 is placed in a room where environmental conditions like 
5 temperature are not controlled. 

Feedback from the photosensor 47 can also be employed to inform the operator 
as to when optimum recording conditions are or will be reached. The operator can then 
activate the film conversion process for example by rolling the fihn 4 across the film 
guide 34 and/or record images on the photosensitive detector arrays 54, 64, 74. 

10 Feedback can be directed to the operator through a display such as described above or to 
electronics that activate the film conversion process automatically. 

Another feature of the invention described below is standby heating element 45 
placed near to lamp 22 in such a position that it does not obstruct the illumination from 
lamp 22 delivered to film 4, but still delivers heat in substantially the same location as 

15 lamp 22. 

Housing the Scanning Subassembly 6 Within A Casing 97 

The structural placement of the subassembly elements of Figure 2 into a casing 
97 is illustrated in Figure 3. As noted above, the preferred embodiment of the invention 
locates the precision optics and film guide 34 in a compact, removable and substantially 

20 dust-free environment. These features are advantageously provided by locating the light 

source, the film guide 34, and the group of film-to-video sensors 54, 64, 74 in three 
separate locations not arranged on a single line. 
The Illumination Subassembly 81 

The first location, formed by component mounting frame 85, film guide plate 8, 

25 and the outer walls of casing 97, houses the illumination subassembly 81. Within the 

subassembly 81 and mounted to component mounting frame 85 are the bases for lamp 
22 and heating element 45. Lamp mount 95 for lamp 22 preferably allows adjustment 
of position of lamp 22 for optimization of the illumination in a manner well known to 
those skilled in the art. Frame 85 also supports condensers 24, 27, filter 26 and shield 

30 28. Shield 28 and optical filter 26 within the subassembly 81 eliminates or reduces rays 
of hght that are not of the desired orientation or wavelength from the optical path 21 to 
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film 4. Aperture 84 in film guide plate 8 allows the optical path 21 from the 
illumination subassembly 81 to pass through film guide plate 8 to beam bending mirror 
30. 

A resealable access port 96 provides access for changing lamps 22 and heating 
5 element 45 and adjusting lamp mount 95. 

The Film-Guide Subassembly 82 

A significant feature of this invention is that the components providing the 
critical film path through the film guide 34 are mounted to a rigid fihn guide plate 8 
independent of the film transport plate 2 of the film drive mechanism described above 
10 and shown in Figure L As shown in Figure 3, film guide 34 and guide rollers 93 are 

precisely mounted on fihn guide plate 8 so that together they are in position to guide the 
film 4 precisely past illuminated slit 33. 

In order to obtain repeatable images firom the fihn being scanned, it is very 
important that the film be held in a precisely controlled position past slit 33. As shown, 
15 the film guide rollers 93 are on separate film guide plate 8. The precision required in 

placement of these guide rollers 93 is much higher than the precision required for 
placement of the film transport components shown in Figure 1, such as supply spool 3, 
take-up spool 9, idler rollers 5 or tensioning rollers 7 which are shown mounted on film 
transport plate 2. Having this smaller film guide plate 8 separate and removable fi-om 
20 film transport plate 2 allows the two plates to be manufactured to different tolerances. 

A film position detector, whether an encoder attached to one of guide rollers 93, 
or other detection system, is also advantageously attached to film guide plate 8. In this 
way, all the highest precision optical and mechanical components are mounted together 
on precision film guide plate 8. Alternately, if the motion of film 4 is controlled by a 
25 capstan driven by a motor, then the location of the capstan would advantageously be 

substituted for one of guide rollers 93, and the capstan driver motor mounted under film 
guide plate 8. 

Another feature of the preferred embodiment is that folding of the optical path 
allows most of the components of the illumination subassembly 81 and the imaging 
30 subassembly 83 to be placed on the under side of film guide plate 8, the film guide 34 
and film 4. This results in an uncluttered film transport plate 2 by reducing the number 
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of components on the working surface of film transport plate 2 and film guide plate 8. 
This reduction makes it easier to handle film 4 with accidental damage to the film 4 
being less likely. Safe handling of film is extremely important in the film conversion 
process, especially when irreplaceable negatives are being scaimed. 
5 Maintaining a Dust-Free Environment 

Scanning film inherently creates dust and residue which will degrade the 
performance of an optical system if allowed to collect on the optical surfaces. In 
addition, the film path preferably is readily accessible to an operator so that the film can 
be easily changed. 

10 In addition, the components of the optical system and the electronic optical-to- 

video components are preferably mounted in a sealed enclosure to keep the optical 
components clean. This enclosure is preferably resealable. 

Referring to Figure 3, housings 91 and 92 are attached to film guide plate 8 on 
the same side of film guide plate 8 as film 4, Housing 91 is sealed with removable 

15 window 32 which allows passage of optical path 31 to film 4 while preventing access 
for contamination to mirror 30 and aperture 84. Similarly, housing 92 is sealed with 
removable window 36 which allows passage of optical path 37 while preventing access 
for contamination to mirror 38 and aperture 86. Also shown is film guide cover 98 
which is made opaque to minimize the light entering imaging subassembly 83 fi-om 

20 extraneous sources other than by the controlled illumination of film 4 at slit 33 by 
illumination subassembly 81. 

As shown in this preferred embodiment, the windows 32 and 36 are located on 
either side of film guide 34, and between film guide 34 and bending mirrors 30 and 38, 
so that all other components of the optical system are enclosed and protected firom dust 

25 or other deposits. The windows 32, 36 are mounted in the housings 91, 92 which are 

attached to film guide plate 8. Housings 91, 92 are each constructed in such a way as to 
enclose all the other optical components, such as bending mirrors 30 and 38, which are 
on the same side of film guide plate 8 without interfering with the optical paths 21,31, 
37, 39. Housings 91, 92 and casing 97 are preferably made of opaque material to 

30 minimize stray light which might interfere with the controlled light in the optical 
system. Another feature of this preferred embodiment is that the windows 32, 36 are 
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easy to clean, and easy to replace if damaged, as may happen in the process of cleaning 
or in other ways. In an alternative embodiment, the appropriate surface of an optical 
component such as a lens or a prism could serve as a window, and this minimizes the 
number of components and also the number of optical surfaces at which losses of image 
5 quality may occur. However, it is expensive to replace a damaged component such as a 

lens or prism, and replacement may require realignment of the optical system. Glass 
windows 32 and 36 advantageously made from a low dispersion glass such as Schott 
low dispersion glass BK-7 available from Melles Griot, 1770 Kettering Street, Irvine, 
California 92714-5670, with optical coatings to reduce surface reflections in a manner 

10 well known in the art are employed. Windows 32, 36 thus have minimal effect on the 

optical path of a system as described herein, and may be replaced with like windows 
without need for reahgnment or recalibration of the system. 

Casing 97 is attached to film guide plate 8 so that it encloses all the components 
of illumination subassembly 81 and imaging subassembly 83. Electrical signals may be 

15 brought into and out of the space substantially enclosed by casing 97 and film guide 
plate 8 through electrical coimectors 99. Access for changing lamp 22 or adjusting 
lamp mount 95 may be made through resealable access port 96. Similar resealable 
access ports (not shown) may be provided for adjusting the positions of movable sensor 
plate 89 or lens mount 87, or for any other mechanical adjustment which may be desired 

20 during operation of the device. Rotating or sliding linkages of a kind well known to 

those skilled in the art may be provided at such access ports through sealed bearings so 
that their activation does not risk introduction of contamination to the optical 
components. 

The Imaging Subassemblv 83 

25 Components of imaging subassembly 83 are mounted on the other side of 

component mounting frame 85 from illumination subassembly 81. Imaging lens 40 is 
mounted on movable lens mount 87. Beam splitter prism 42 and linear photosensor 
arrays 54, 64, 74 and intervening optional optical filters, are also advantageously 
mounted on movable sensor plate 89. In tum lens moxmt 87 and sensor plate 89 are 

30 attached to component mounting frame 85 in a manner which allows adjustment of their 

position to provide focusing and to change the magnification of imaging subassembly 
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83. Optical path 39 from mirror 38 is directed through aperture 86 in film guide plate 8 
to lens 40. 

This embodiment of the imaging subassembly 83 in the present invention 
comprises imaging lens 40 which produces an image of an illuminated strip of film 4 on 

5 linear photosensor arrays 54, 64, 74. The optical path 41 from imaging lens 40 to linear 

photosensor arrays 54, 64, 74 is spUt into three optical paths 50, 60, 70 by beam 
splitting prism 42. Beam splitting prism 42 preferentially reflects or transmits different 
bands of wavelength of the Ught incident on the prism into each of the three optical 
paths 50, 60, 70. A separate linear photosensor array 54, 64, 74 is placed at the imaging 

10 plane of each of the three optical paths 50, 60, 70 respectively. The wavelength ■ 

response of each path may be refined by placing additional optional optical filters 51, 
52, 53, and 61, 62, 63, and 71, 72, 73 in each of the three optical paths 50, 60, 70 
respectively. Imaging lens 40 is mounted on movable lens mount 87 which may be 
adjusted to optimize the focus of the image, for example when changing from one film 

15 to another having a different thickness. Beam spUtting prism 42 and linear photosensor 
arrays 54, 64, 74 are mounted on movable sensor plate 89, as are any optical filters as 
described above or other components interposed between beam splitting prism 42 and 
linear photosensor arrays 54, 64, 74. Movement of this sensor plate 89 in combination 
with movement of lens mount 87 may be used to produce a change in the magnification 

20 of the images focused on the linear photosensor arrays 54, 64, 74. The dimensions of 
these components make it highly desirable that the optical path to the imaging 
subassembly 83 be folded so that these components can be separated from the surface of 
film transport plate 2. 
The Standbv Heating Element 45 

25 Standby heating element 45 is placed near to lamp 22 in such a position that it 

does not obstruct or otherwise interfere with the illumination from lamp 22 dehvered to 
film 4, but still delivers heat in substantially the same location as lamp 22. Lamps 
suitable for providing illumination in, for example, a telecine device have limited 
lifetime, and it often is desirable to turn off the lamp 22 when film 4 is not being 

30 scanned. However, when the power dissipation of the lamp is removed, the system will 

tend to cool down or change its temperature distribution, which must be re-stabilized 
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when scanning is resumed. The standby heating element 45 is selected to have a very 
long lifetime, and to dissipate a similar amount of povv^er to the lamp 22. Control 
circuitry (not shown) within cabinet 100 (Figure 1) advantageously turns on the standby 
heating element 45 when the lamp 22 is turned off to maintain a standby condition with 
5 constant total power dissipation, so that the temperature and temperature distributions 

will change less when lamp 22 is tumed off Similarly, heating element 45 is turned off 
when lamp 22 is tumed on. In this way, the total dissipation of power is kept 
substantially constant. Preferably, the standby heating element 45 will be powered by 
the same supply as lamp 22, so that the power supply also will experience minimum 

10 changes of operating conditions when entering standby mode. A desirable form of the 
standby heating element 45 is a lamp with hfetime of operation of several years, so that 
it will emit some radiation which will pass through the optical system in a pattem 
somewhat similar to the radiation from lamp 22 and, thus, avoid substantial temperature 
variations in the optics elements. 

15 An alternative control of the standby heating element 45 is to dissipate a certain 

power when lamp 22 is operating, and to deliver a greater power when lamp 22 is tumed 
off For example, standby heating element 45 may dissipate a certain excess power Ws 
when lamp 22 is operating at a power of Wi, and then standby heating element 45 is set 
to dissipate a power approximately Ws + Wi when lamp 22 is tumed off Again, the 

20 total dissipation of power is kept substantially constant. In this case, a further 
improvement to the system may be realized. One or more temperature sensors 43 may 
be positioned near the optical system. Information from these temperature sensors 43 
may be used to control the excess power Ws delivered to the standby heating element 
45, in such a manner that variations in this excess power dissipation can stabilize the 

25 temperature of the entire optical system against some variations in extemal conditions. 

Having a standby heating element 45 placed near to lamp 22 is usefixl for 
applications that exploit the portable nature of the film conversion device 1. As 
discussed above, as this device 1 is moved about, the environmental conditions such as 
temperature change. For example, the film conversion device 1 may be placed in a 

30 room where the environmental conditions like temperature are not controlled. The 
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standby heater element 45 is also particularly useful when the film conversion device 1 
is located in a hot location. 
Other Advantages 

When the optical path is bent or folded as described in the preferred 
5 embodiment, a number of advantages are attained. Because folding reduces the 

maximum extension of the optical system, the optical system can be made more 
compact. In turn, the entire film conversion device 1 is made hghter and lower in cost. 
In the preferred embodiment of the folded optical system in the film conversion 
device 1, as shown in Figures 2 and 3, scarming subsystem 6 is mounted on film guide 

10 plate 8 which is seen in Figure 1 to be flush with but removable from film transport 
plate 2. Component mounting frame 85 is attached to film guide plate 8 on the other 
side of film guide plate 8 from film guide 34. Illumination subassembly 81 and the 
imaging subassembly 83 are mounted on opposite sides of component mounting frame 
85. The optical path between these two assemblies and the film guide subassembly 82 

15 is directed by bending mirrors 30, 38 in such a way as to pass through apertures 84, 86 

in film guide plate 8. 

In order to obtain satisfactory image information from a film conversion device, 
such as a telecine machine, it is necessary to have a precision optical system. A 
precision optical system is a system in which precision optical components are used and 

20 in which these components can be aligned precisely and will remain in alignment under 

varying conditions, particularly under variations of temperature. The folding of the 
optical path makes it possible to reduce the dimensions of the structure on which the 
optical components are mounted. Reduced dimensions of supporting structures such as 
film guide plate 8 and component mounting frame 85 give an advantage of performance 

25 and cost. This is a particular advantage in establishing stability against variations in 

temperature as material having low thermal expansion can be employed in forming the 
film guide plate 8 and mounting frame 85. 

During operation of the film conversion device, the longitudinal movement of 
the film is preferably monitored very closely so that the scaimed image from one frame 

30 of the film will match that from the next frame. The speed of the film 4 can be 

measured by means of an encoder or other measuring component which is moved by the 
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film 4, and this encoder information can be used by a servomechanism to control the 
movement of the film 4 at a desired speed. However, the low voltage analog electrical 
signals such as those from an encoder are well known to be susceptible to noise and 
interference. The electrical signals from linear photosensor arrays also have this type of 
5 susceptibility to noise and interference. Accordingly, it is desirable to shield such 

analog signals from nearby electrical noise sources with a barrier of electrically 
conducting material. Housings 91, 92 and casing 97 described above, which protect 
illumination subassembly 81 and imaging subassembly 83 from dust and contamination, 
are advantageously constructed from electrically conducting materials to provide 

10 electrical shielding for the small analog signals from linear photosensor arrays 54, 64, 
74 of imaging subassembly 83. 

Components for measuring the position and/or speed of the fihn 4 include an 
optical sensor array for detecting sprocket holes in the film or a rotary encoder on a 
capstan driving the film or on a guide roller driven by the film. The preferred 

15 embodiment of the invention shown enables locating these components on film guide 

plate 8 and electrically shielding the output of these components by the same 
electrically conducting casing 97 which protects the illumination subassembly 81 and 
imaging subassembly 83. An additional advantage is gained by making casing 97 of a 
material such as aluminum which is also a good thermal conductor, so that it will help 

20 to distribute heat around the optical system and so make it easier to stabilize the 
temperature profile of the optical elements. It is advantageous for the same reason also 
to make the housings 91, 92 and film guide plate 8 to be electrically conducting and 
good thermal conductors. Yet another benefit of the stabiUzation of thermal 
environment made possible in this way is the stabihzation of analog electrical circuits 

25 such as those described above which are sensitive to variations in the thermal 
environment. 

Power Control and Data Circuitry within Subassembly Casing 97 

Module 6 of the preferred embodiment further includes the circuitry and 
conductors shown in the block diagram of Figure 4. Although the major portion of the 
30 timing, control and data handhng electronics coupled to the linear photosensor arrays 

54, 64, 74 are included as part of the circuitry 10 of film conversion device 1 shown in 
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Figure 1, it is advantageous to provide a portion of the timing and control circuitry 1 10 
closely proximate to each of the linear photosensor arrays 54, 64, 74. This timing and 
control electronics 110 is connected by respective conductors 115, 116, and 117 to the 
arrays 54, 64 and 74 and the electronics 110 receives signals from circuitry 10 via a 
5 suitable conductor 109 connected to a suitable electrical connector at panel 99. 

Additional conductors (not shown) that are suitable and are well known in the art, 
couple the timing and control electronics 110 to each of the amplifier and analog-to- 
digital-circuits 55, 65, 75 described below. However, the use of such conductors is not 
so limited. 

10 The analog signals from each of the linear photosensors arrays 54, 64, and 74 are 

coupled by respective suitable conductors 120, 121, and 122 to respective amplifier and 
analog-to-digital circuits 55, 65, 75. These circuits are also advaatageously located 
closely physically proximate to the arrays so as to make the length of the conductors 
120, 121 and 122 carrying the analog signals as short as possible. The output digital 

15 signals on conductors 125, 126, 127 are substantially less susceptible to noise than the 

analog signals output by the arrays. As shown, these output digital signals from circuits 
55, 65, and 75 are connected via suitable signal conductors 125, 126, 127 to a suitable 
connector at the electrical connector panel 99. 

Power for the timing and control electronics 110, sensors 54, 64, 74, amplifier 

20 and A-D circuits 55, 65, and 75 is also provided over suitable power leads (not shown) 
from a connector or connectors on panel 99. 

Power for the lamp 22 and standby heating element 45 are provided by 
respective suitable conductors 130 and 131 connected to one or more connectors on 
panel 99. The output signals from temperature sensor 43 and photosensor 47 are 

25 connected to connectors in panel 99 by suitable conductors 135, 136. 

Connections between Subassembly Casing 97 And Film Transfer Cabinet 100 

Once the subassembly 6 is installed with the film conversion device 1 of Figure 
1, leads (not shown) within this cabinet 100 connect the connectors on panel 99 to either 
the circuitry 10 of Figure 1 or to the data ports 13 shown in Figure 1. 

30 
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Digital Processing Core 

Figure 5 shows a functional block diagram for processing images in one 
embodiment of a film conversion device 1. Mechanical and optical devices 521 provide 
images from a sequence of film frames simultaneously to two or more linear 
5 photosensor arrays 54, 64, 74. In one embodiment, three linear photosensor arrays 54, 

64, 74 are used to detect a full range of color information. For example, the first linear 
photosensor array 54 detects red, the second hnear photosensor array 64 detects green, 
and the third linear photosensor array 74 detects blue. The mechanical and optical 
devices 521 provide information to a position detection logic 522 that ftirther provides 

10 information to a film transport control 523. The information from the position detection 
logic 522 helps the film transport control 523 with synchronizing film motion with film 
imaging. The film transport control 523 and the mechanical and optical devices 521 
communicate with each other to control the speed at which images are provided to the 
linear photosensor arrays 54, 64, 74. The film transport control 523 also controls the 

15 operation of the linear photosensor arrays 54, 64, 74. In one embodiment, the film 

transport control 523 is a microprocessor that also controls the exposure time, clocking, 
latching and output of data for the linear photosensor arrays 54, 64, 74. 

The outputs of the linear photosensor arrays 54, 64, 74 are analog signals with 
amplitudes proportional to the amount of light seen by each respective photosensor 

20 array 54, 64, 74. The analog signals correspond to scaxmed film pixels and are 

organized by scan lines. The analog signals are provided to respective amplifier and 
analog-to-digital circuits 55, 65, 75 for filtering, ranging and converting each scanned 
film pixel into digital bits. In one embodiment, the linear photosensor array 54, 64, 74 
is a 2048-pixel linear array (i.e.. Line Scan Camera RS 644) with two output channels 

25 that each output at 30 Mega-Hertz (MHz) but can be combined for an effective 

bandwidth of 60 MHz. In one embodiment, the Analog-to-Digital Converter (ADC) of 
the amplifier and analog-to-digital circuit 55, 65, 75 is a commercially available 12-bit 
ADC. With three linear photosensor arrays 54, 64, 74 and a 12-bit ADC, 36 bits of raw 
color data are provided per scanned film pixel. The film pixel resolution can be 

30 increased as commercial ADCs improve. 36 bits are sufficient to support a 24-bit or a 
30-bit color equivalent film conversion output. 
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The digital bits from the output of the amphfier and analog-to-digital circuits 55, 
65, 75 are provided to a processing core 500 where the digital bits are processed 
digitally. The processing core 500 performs film conversion functions, including 
illumination and detection normahzation 530, digital filtering 531, color conversion 
5 532, pan and scan adjustment 533, and split screen 534. Color conversion 532 is also 

known as color correction. A frame controller 538 accepts inputs from an operator 537, 
a key-code reader 536 and the position detection logic 522 to control the pan and scan 
adjustment 533. The frame controller 538 also controls a color lookup table generator 
539 that provides input to the process of color conversion 532. In one embodiment, the 

10 operator 537 also provides input to control the split screen 534. 

Generally, it is common to perform one or more effects (e.g., pan and scan 
adjustment and color conversion) on a particular frame or sequence of frames in film 
conversion operations. The operator 537 defines the desired effects during the film 
conversion session. In one embodiment, the key-code reader 536 reads synchronizing 

15 information directly off the side of the film and helps the frame controller 538 to 

monitor the frame number of the film as the film's images are being read and processed. 
The frame controller 538 ensures that the color lookup table generator 539 provides the 
proper color conversion 532 for the current film frame as defined by the operator 537. 
The color lookup table generator 539 can be a list of values, a mathematical formula, or 

20 a combination of both. 

The output of the processing core 500 can be displayed on a monitor 18, such as 
a video monitor or a digital monitor, or provided to a formatter 535. The formatter 535 
manipulates the digital output from the processing core 500 into one or more desired 
formats. In one embodiment, one of the outputs of the formatter 535 is the video output 

25 of the film conversion device 1 in a digital format. In an alternate embodiment, a 

digital-to-analog converter converts one of the outputs into an analog signal. The 
outputs can be provided to the data port 13 or the removable media 14 for recording 
onto storage elements such as a disk drive or DVD. In one embodiment, the output if 
the formatter 535 is stored in local memory 599. Digital video formats include Quick 

30 Time Movie File, Audio/Video Interleaved, Digital Video, Cineon and Moving Picture 

Experts Group (MPEG), The digital video formats can be configured to display the 
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digitally stored information in conformance with video standards such as NTSC, PAL, 
SEC AM or one of the digital video standards. 
Parallel Processing Core 

Figure 6 is a block diagram of electronics in a parallel-processing core 500 of 

5 one embodiment of a film conversion device 1. The parallel-processing core 500 

includes FPGA elements 503, 504, 505 and frame-buffer memory banks 501. Frame- 
buffer memory banks 501 can be Random Access Memory (RAM) electronic chips 
which are capable of storing information from one or more film cells. In one 
embodiment, the frame-buffer memory banks 501 are organized in a convenient data 

10 structure such as a circular queue. Film information is stored linearly (i.e., in the order 
it is processed by the amplifier and analog-to-digital circuits 55, 65, 75). DSP elements 
are alternatives for FPGA elements 503, 504, 505. A combination of DSP elements and 
FPGA elements can be used as well. In this application, the FPGA element represents a 
set of necessary hardware to perform a complete fimction. The set of necessary 

15 hardware can be a FPGA, a portion of a FPGA or multiple FPGAs. For example, 

illumination and detection normahzation 530 is a relatively simple fimction so the 
FPGA element configured to perform that fimction requires a portion of the FPGA. 
Alternatively, color conversion 532 and formatter 535 are complex fimctions where 
multiple FPGAs make up the FPGA element. 

20 The FPGA elements 503, 504, 505 are configured to perform the film 

conversion functions described above. In one embodiment, the film conversion 
functions are divided into three groups. The first group of N FPGA elements 503 
receives inputs corresponding to scanned film image pixels from the amplifier and 
analog-to-digital circuits 55, 65, 75 and performs input processing. Input processing 

25 includes illumination and detection normalization 530 and digital filtering 531. The 

outputs from the first group of N FPGA elements 503 are temporarily stored in Q 
frame-buffer memory banks 501 . 

The second group of P FPGA elements 505 can concurrently read and process 
pixel data previously stored in the Q frame-buffer memory banks 501 by the first group 

30 of N FPGA elements 503. The second group of FPGA elements 505 perform 

intermediate film conversion functions (e.g., color conversion) not directly related to the 
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input or the output of information from the parallel processing core 500. The outputs 
from the second group of P FPGA elements are stored back to the Q frame-buffer 
memory banks 501 . 

The third group of M FPGA elements 504 receives inputs from the frame-buffer 
5 memory banks 501 and completes processing the pixels. The final sequence of film 

conversion operation includes the pan and scan adjustment 533 and the split screen 534. 
Outputs of the completely processed pixels from the third group of M FPGA elements 

504 are provided to the monitor 18 or provided to the formatter 535. The number of 
pixels in the film conversion output can be different than the number of scanned film 

10 pixels due to the grouping, filtering and encoding functions in the fihn conversion 
device 1. For example, the number of pixels can change after the digital filtering 531 or 
the pan and scan adjustment 533. Information from two or more scanned film pixels 
can be combined to achieve the desired resolution, data encoding or data compression. 
In one embodiment, a supervisory control circuit 502 is responsible for the 

15 initialization and shutdown of the parallel-processing core 500. The supervisory control 

circuit 502 accepts inputs from the operator 537, the frame controller 538, and the color 
lookup table generator 539 to also control functions in the parallel-processing core 500 
during the film conversion session. The supervisory control circuit 502 can 
communicate with each group of FPGA elements 503, 504, 505. The supervisory 

20 control circuit 503 updates instructions to respective group of FPGA elements 503, 504, 

505 in such a way so as not to interfere with the film conversion device 1 while pixel 
data is read from or written to the frame-buffer memory banks 501. For example, the 
supervisory control circuit 503 makes updates to respective group of FPGA elements 
503, 504, 505 in between frames. The supervisory control circuit 502 can also access 

25 data stored in the frame-buffer memory banks 501 via one of the group of FPGA 

elements 503, 504, 505. The supervisory control circuit 502 indirectly dictates how 

each film image pixel is processed. 

In the preferred embodiment, each group of FPGA elements 503, 504, 505 

includes two or more FPGA elements to facilitate parallel processing. For example, two 
30 or more scanned film pixels can be processed simultaneously by two or more sets of 

FPGA elements in a group. In addition, each group of FPGA elements 503, 504, 505 
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can simultaneously process a different set of scanned film pixels. This two-dimensional 
parallel processing structure facilitates faster than real-time film conversion sessions. 
The supervisory control circuit 502 has concurrent control over the FPGA elements. 
The frame-buffer memory banks 501 used to store partially processed pixels can be 
5 accessed in parallel by muhiple FPGA elements for further processing. The numbers of 

FPGA elements in respective groups of FPGA elements 503, 504, 505 and the number 
of frame-buffer memory banks 501 can be varied independently to achieve a desired 
configuration. 
Configurable Electronics 

10 FPGA elements and DSP elements are compact, configurable electronic 

elements that can perform a variety of fimctions. The electronic circuitry 10 for full 
film conversion can be placed on a single circuit board. The configurability of the 
FPGA elements and the DSP elements provides flexibility and non-obsolescence. 
Various combinations of fihn conversion functions can be implemented from the same 

15 set of electronics in the parallel-processing configuration described above. The physical 

structure of the film conversion device 1 can remain the same as the functions of the 
film conversion device 1 are redesigned to suit desired needs. Customized 
programming of FPGA elements and DSP elements is a cost-efficient method to build 
individual film conversion devices 1. Moreover, FPGA and DSP functions can be 

20 altered during the film conversion session, or at any other time, via software codes. 

In one embodiment, a low-cost film conversion device 1 designed for consumer 
or a standard television market can have fewer FPGA elements while a high-end film 
conversion device 1 designed for faster than real-time operation or a high-definition 
television market requires more FPGA elements. However, the number of FPGA 

25 elements in each group of FPGA elements 503, 504, 505 can be selected for cost 

efficiency. In one embodiment, the film conversion device 1 utilizes three linear array 
sensors 54, 64, 74, each with two outputs. The film conversion device 1 advantageously 
includes six (N=6) FPGA elements in the first group of FPGA elements 503 to process 
respective outputs from the linear array sensors 54, 64, 74 in parallel. A lower number 

30 of FPGA elements can be used with two or more outputs from the linear array sensors 

54^ 64, 74 buffered for serial processing by a shared FPGA element, thereby reducing 
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the throughput of the film conversion device 1. A higher number of FPGA elements 
can be used to improve the throughput of the fihn conversion device I, if cost so 
permits. For example, two or more FPGA elements can interleave the processing of 
adjacent film image pixels fi-om one linear array sensor 54, 64, 74. At the same time, 
5 more linear array sensors 54, 64, 74 can used to increase the throughput of scanned film 

pixels. Two or more sets of linear array sensors 54, 64, 74, with appropriate 
adjustments to the mechanical and optical devices 521, can be used to boost the 
scanning throughput to facilitate faster film conversion operation. 

In the embodiment with three Unear array sensors 54, 64, 74, the film conversion 

10 device 1 also includes six (P=6) FPGA elements in the second group of FPGA elements 

505 to maintain the throughput. More FPGA elements can be used in the second group 
of FPGA elements 505 to ease timing requirements of the fi-ame-buffer memory banks 
501. Moreover, FPGA elements can be tiered within each group to increase the 
throughput of complex functions such as digital filtering 531 or color conversion 532. 

15 For example, digital filtering 531, which takes T seconds to perform, can be divided 

into a two step even-time process. The first step, which takes T/2 seconds to perform, is 
implemented by a FPGA element in tier 1 and the second step, which also takes T/2 
seconds to perform, is implemented by a FPGA element in tier 2. A first set of pixels is 
processed in tier 1 followed by processing in tier 2. While the first set of pixels is being 

20 processed in tier 2, a second set of pixels can be processing in tier 1. In this manner, 

completely processed pixels are outputted every T/2 seconds, thereby doubling the 
throughput in comparison to a non-tiered approach. 

The third group of FPGA elements 504 includes nine (M=9) FPGA elements 
plus any necessary digital-to-analog converters (not shown) to maintain the throughput 

25 and to simultaneously provide two or more outputs. For example, three FPGA elements 
are used to generate a NTSC video signal which is processed by a digital-to-analog 
converter and displayed on the monitor 18 for monitoring purposes during the film 
conversion process. The other six FPGA elements are used to simultaneously generate 
two or more outputs that can include analog video standards such as NTSC, PAL or 

30 SECAM and digital multimedia standards which are converted to a specified format in 
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the formatter 535. This configuration of twenty-one FPGA elements can be represented 
as "6-6-9" (N-P-M). 

Using FPGAs from Xilinx (part number XC4044XL), the 6-6-9 parallel 
processing configuration can perform real-time film conversion for high-definition 
5 television and related file formats or faster than real-time film conversion for standard- 
definition television and related file formats. Figures 8A and 8B contain tables to 
illustrate the throughput rates for various video formats using the 6-6-9 parallel 
processing configuration. Table A lists common film image formats. Table B shows 
faster than real-time film conversion throughput for standard-definition television. 

10 Table C shows faster than real-time film conversion throughput for 720x1280 high- 

definition television and near real-time film conversion throughput for some 1080x1920 
high-definition television. 

The structure of the digital parallel-processing core 500 advantageously allows 
for flexible configurations. In one embodiment, a 3-0-6 parallel processing 

15 configuration is an economical downscaled film conversion device 1 that provides a 

single video output for standard-definition television without advanced stages of color 
conversion 532. In an alternative embodiment, two sets of three linear sensor arrays 54, 
64, 74 and a 12-12-12 parallel processing configuration make up a high performance 
upscale film conversion device 1 that provides faster than real-time film conversion for 

20 high-definition television and simultaneous outputs in multiple formats. The 

throughput rates hsted in Figures 8 A and 8B are doubled using the 12-12-12 parallel 
processing configuration. The structure of the digital parallel processing core 500 
adapts easily to faster or increasing numbers of linear sensor arrays 54, 64, 74. 
Faster Than Real-Time Audio and Metadata 

25 Ancillary information (e.g., audio and metadata information) is processed and 

synchronized with film images in the film conversion process. In a preferred 
embodiment, a film conversion device 1 includes means to process the ancillary 
information to match the faster than real-time throughput of the film images. Figure 7 
is a functional block diagram for processing ancillary information in one embodiment of 

30 the film conversion device 1. An ancillary processor 701 in the film conversion device 

1 accepts inputs fi-om one or more of the following external analog and digital sources: 
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a variable-speed audio source 751, a real-time audio source 752, a digital audio source 
753 and a digital data source 754. The ancillary processor 701 includes a rate 
synchronizer 755, an analog-to-digital converter 756, a digital data buffer 757, a pitch 
adjuster 758, a digital audio rate adjuster 759, a digital data rate adjuster 760, and the 
formatter 535. 

Information from the variable-speed audio source 751 is processed by the rate 
synchronizer 755 to match the film conversion rate of the fihn images. The output of 
the rate synchronizer 755 is provided to the formatter 535, Information from the real- 
time audio source 752 is converted to digital values by the analog-to-digital converter 
756. The digital values are buffered by a digital data buffer 757 as they wait for 
processing by the pitch adjuster 758. The pitch adjuster 758 frequency shifts the 
information represented by the digital values to match the film conversion rate of the 
film images. The output of the pitch adjuster 758 is provided to the formatter 535. 

Information fi-om the digital audio source 753 is processed by the digital audio 
rate adjuster 759 to match the film conversion rate of the film images. Digital audio 
sources 753 include musical compact discs, Avid files or QuickTime files. The audio 
signals from the digital audio sources 753 can be recorded at the same rate as the 
eventual playback rate, and the output of the digital audio rate adjuster 759 is provided 
to the formatter 535. If the audio signals from the digital audio sources 753 are 
recorded at a different rate than the eventual playback rate, the output of the digital 
audio rate adjuster 759 is provided to the digital data buffer 757 to wait for processing 
by the pitch adjuster 758. The pitch adjuster 758 frequency shifts the digital audio 
signals to match the playback rate. The output of the pitch adjuster 758 is provided to 
the formatter. Information from the digital data source 754 is processed by the digital 
data rate adjuster 760 to match the film conversion rate of the film images. The output 
of the digital data rate adjuster 760 is provided to the formatter 535. 

In one embodiment, the digital audio source 753 provides encoded data. For 
example, sound is encoded as frequency and amplitude in MP3. The digital audio rate 
adjuster 759 decodes the encoded data and reencodes the data for the desired playback 
rate. 
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The formatter 535 processes both film images and ancillary information. The 
formatter 535 accepts ancillary information that is in a digital form with a data rate that 
matches the fihn conversion rate of film images. The formatter 535 manipulates the 
ancillary information into a selected format. The formatter 535 combines the ancillary 
5 information with the fihn images in the video output provided to the data port 13 or the 
removable media 14. The data stream containing ancillary information, such as selected 
metadata information, is inserted in appropriate places in the data stream containing 
fihn images. 

Although described above in connection with particular embodiments of the 
10 present invention, it should be understood the descriptions of the embodiments are 
illustrative of the invention and are not intended to be limiting. Various modifications 
and applications may occur to those skilled in the art without departing firom the true 
spirit and scope of the invention as defined in the appended claims. 
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